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sentation  used  in  cognitive  psychology  and  artificial  intelligence  are 
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1.  Introduction 


Manual  control  is  typically  defined  to  be  a situation  in  which  a person 
receives  information  about  the  system  he  controls  through  his  various  senses 
and  provides  directive  or  corrective  information  to  the  controlled  system 
through  one  or  more  actuating  devices.  Practical  situations  in  which  humans 
perform  manual  control  tasks  are  many  (driving  automobiles,  flying  aircraft, 
running  machine  tools)  and  much  effort  has  been  spent  on  constructing  both  engi- 
neering and  scientific  theories  of  manual  control. 

These  theories  do  an  excellent  job  of  prediction  within  a limited  domain. 

In  particular,  there  exist  both  classical  and  optimal  control  theoretic  methods 
for  predicting  performance  on  compensatory  tracking  tasks  (see  Sheridan  and 
Ferrell  (1974)).  Unfortunately,  human  operators  are  included  as  components 
in  control  systems  to  provide  control  and  information  processing  skills  in  addi- 
tion to  those  required  to  successfully  perform  compensatory  tracking. 

To  the  control  systems  engineer  the  human  is  the  ideal  component  to  in- 
clude in  a system  which  must  operate  in  a partially  unknown  environment.  The 
human  is  adaptable.  He  can  recognize  and  compensate  for  unusual  circumstances 
and  infrequent  events.  He  can  operate  in  nonconstant  environments  and  provide 
context  sensitive  control  unattainable  with  completely  automatic  systems.  In 
other  words,  the  human  operator  is  the  component  which  compensates  for  the 
engineer's  necessarily  incomplete  knowledge  of  the  world  in  which  the  system 
he  is  designing  will  be  used.  Human  perceptual  and  cognitive  abilities  still  far 
exceed  those  of  any  artificially  intelligent  system  yet  considered  and  the  human 


operator  will  certainly  remain  a key  element  in  many  control  systems  of  the 
fixture. 

Young  (1969)  and  Sheridan  and  Ferrell  (1974),  among  others,  have  re- 
cognized the  above  point  and  have  argued  that  the  primary  role  of  the  operator 
(or  operators)  in  systems  such  as  modern  commercial  aircraft,  air  traffic  con- 
trol systems,  automated  warehouses  and  machining  centers,  is  control  oriented 
supervision  and  management,  and  not  tracking  oriented  control.  The  human  is 
valued  in  these  systems  precisely  for  his  information  processing  abilities  and 
his  ability  to  provide  an  adaptive  decision-making  capability  in  an  otherwise 
automated  system.  In  essence,  the  motor  skill  requirements  necessary  to  con- 
trol the  system  have  been  placed  with  the  machines,  and  the  routine  information 
processing  has  also  been  mechanized,  leaving  the  human  with  the  poorly  under- 
stood remainder. 

The  trend  seems  clear.  The  human  operator  in  future  man-machine 
systems  will  have  to  interact  with  and  operate  highly  automated  and  computer 
controlled  equipment.  He  will  plan,  sequence  and  co-ordinate  rather  than  "con- 
trol.  " It  is  equally  clear  that  our  understanding  of  these  systems  must  improve 
if  the  design  of  these  systems  is  to  be  placed  on  a solid  theoretical  and  empirical 
foundation.  More  attention  will  have  to  be  focused  on  the  evolving  role  of  the 
operator  as  supervisor,  manager  and  adaptive  controller.  Engineering  theories 
specific  to  these  tasks  will  have  to  be  developed.  It  is  toward  this  end  that  this 
paper  is  directed. 
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The  key  hypothesis  underlying  the  research  reported  here  is  that  the 
concepts  of  control  theory  and  engineering  can  enable  progress  in  manual  con- 
trol  research,  but  the  typical  association  of  control  theory  with  the  mathematics 
of  linear  systems,  servomechanisms  and  optimal  control  is  too  restricting.  For 
guiding  research  at  least,  the  concepts  should  be  separated  from  the  usual 
methods.  The  use  of  a particular  type  of  mathematics  in  control  theory  is  mo- 
tivated  in  part  by  the  substance  of  control  problems,  but  it  is  also  motivated  by 
the  desire  to  get  "results. " Hence,  the  technical  assumptions  of  a particular 
control  theory  are  not  necessarily  desirable  nor  acceptable  when  the  objective 
is  a theory  of  some  aspect  of  manual  control.  There  seems  to  be  a need  to 
clearly  delineate  the  domain  of  manual  control  theory,  particularly  the  type  of 
supervisory  and  adaptive  manual  control  mentioned  above.  This  paper  is  one 
attempt  at  such  a delineation. 

Specifically,  the  main  objective  of  this  paper  is  to  provide  a fairly  formal 
characterization  of  systems  in  which  the  human  operator  fills  the  roles  of  adap- 
tive controller,  co-ordinator,  and  supervisor.  The  work  presented  is  really  at 
a meta-theoretic  level  in  the  sense  that  no  specific  theory  is  developed,  but 
rather  the  types  of  objects  and  relations  which  must  be  addressed  by  specific 
theories  are  defined  and  put  forward  for  examination.  This  hopefully  will  facili- 
tate additional  research  and  theory  construction  In  this  important  area  of  man- 
ual control. 

The  paper  is  organized  as  follows.  A brief  review  of  the  aims  and 
methods  of  manual  control  research  is  presented  in  section  2,  followed  by  a 
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discussion  of  the  concept  of  a adaptation  in  section  3.  The  main  body  of  the 
paper  is  section  4 in  which  a formalization  of  the  generic  control  problem  is 
developed  and  the  objects  and  relations  of  an  adaptive  controller  are  derived. 


The  implications  for  manual  control  modelling  and  research  are  discussed  in 
section  5 and  the  results  are  summarized  in  section  6. 


2.  The  Focus  of  Manual  Control 


The  vast  majority  of  manual  control  research.  Including  that  on  adaptive 
manual  control,  consists  of  attempts  to  construct  a transfer  function  representa- 
tion of  the  human.  Specifically,  the  human  is  represented  by  pairs  of  input  and 
output  signals,  outputs  having  been  obtained  when  the  human  subject  performed 
a control  task  in  which  the  input  signal  was  presented  to  him.  Through  various 
curve  fitting  procedures  a transfer  function,  or  equivalently  a differential  equa- 
tion, representation  of  an  input  to  output  mapping  is  obtained.  The  literature  on 
simple  tracking  tasks  is  vast  and  the  interested  reader  is  referred  to  Sheridan 
and  Ferrell  (1974)  for  an  excellent  introduction  to  the  area. 

Study  of  adaptive  manual  control  is  much  less  comprehensive.  The  usual 
case  consists  of  a compensatory  tracking  task  in  the  face  of  a slowly  changing 
controlled  plant  (controlled  system)  or  in  same  cases  a plant  which  undergoes 
step  changes  in  gain.  McRuer  and  Jex  (1967);  Miller  and  Elkind  (1967);  Phatak 
and  Bekey  (1969);  Young  (1969);  Niemela  and  Krendel  (1975)  are  representative 
of  the  cross  section  and  provide  an  adequate  introduction  to  this  literature. 

There  have  also  been  some  attempts  at  describing  behavior  during  the  learning 
phase  when  subjects  are  first  exposed  to  the  control  task  (see  for  example  Preyss 
and  Meiry  (1968);  Jagacinski  et.  al,  (in  press),  Jagacinski  and  Miller  (1978). 

Some  switching  theory  and  pattern  recognition  methods  have  been  published  in- 
cluding Angel  and  Bekey  (1968);  Gilstad  and  Fu  (1971);  and  Witten  and  Corbin 
(1973). 
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All  of  these  studies  either  describe  the  human's  performance  on  a given 
task  or  compare  human  performance  with  some  automatic  system.  In  both  cases, 
generalization  is  impossible  until  experiments  are  performed  on  a wide  variety 
of  tasks,  and  even  then  generalization  is  limited. 

For  the  most  part  the  above  cites  are  from  the  engineering  or  engineer- 
ing psychology  literature.  The  objectives  of  these  studies  are  essentially  to  de- 
scribe human  performance  in  sufficient  detail  and  in  a form  suitable  for  pre- 
dicting overall  man-machine  system  performance.  It  is  not  surprising  then  that 
the  methods  used  to  describe  the  operator's  behaviors  are  the  same  as  those 

used  to  describe  the  machine's  behaviors  (e.  g.  differential  equations  or  differ- 
ence equations).  In  a sense  the  man  is  described  in  the  same  language  used  to 
describe  his  environment.  This  is  a perfectly  legitimate  (probably  even  desir- 
able) way  to  proceed,  but  it  should  be  recognized  that  it  puts  many  constraints 

on  the  types  of  behaviors  that  can  be  represented. 

The  strategy  used  to  enrich  the  usual  tracking  theories  with  some  fea- 
tures of  adaptive  control  again  follows  the  model  of  engineering  practice.  An 
additional  control  loop  is  added  to  the  representation  and  this  loop  is  intended 
to  account  for  the  process  by  which  the  operator  modifies  or  regulates  the 
parameters  of  the  primary  tracking  loop  in  the  face  of  a changing  environment. 
Young  (1969)  and  Pew  (1974)  provide  particularly  clear  expositions  of  this  strat- 
egy. This  type  of  modelling  process  would  be  quite  satisfactory  for  engineering 
purposes  except  that  the  mathematics  of  the  control  theoretic  analysis  essentially 
precludes  all  but  linear,  time- invariant  representations.  It  is  not  clear  that  the 
human  performs  these  tasks  in  a linear  fashion  using  rules  which  do  not  change 
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over  time.  A mismatch  between  the  technical  means  of  description  and  the 
behaviors  described  again  seems  to  pose  some  severe  limits  on  this  type  of 
theory  of  manual  adaptive  control. 

Also  of  interest  is  an  emerging  body  of  literature  on  supervisory  control 
and  monitoring.  Sheridan  and  Johannsen  (1976)  is  an  excellent  introduction  to 
this  literature  and  it  contains  substantial  bibliographic  information.  This  re- 
search emphasizes  understanding  human  performance  in  monitoring  and  multi- 
task decision-making.  Monitoring  generally  refers  to  situations  in  which  the 
operator  systematically  observes  several  information  sources  in  order  to  classi- 
fy operations  as  normal  or  abnormal  and  to  diagnose  the  causes  of  abnormalities. 
Multitask  decision-making  refers  to  situations  in  which  an  operator  has  several 
tasks  all  of  which  much  be  accomplished  with  some  degree  of  success  if  the  sys- 
tem objectives  are  to  be  met. 

The  type  of  theories  of  supervisor  control  put  forward  to  date  are  based 
on  simple  extensions  of  existing  control  models  (Kleinman  (1976);  Kleinman  and 
Curry  (1977)),  queuing  theory  (Rouse  (1977);  Carbonell  (1966);  Carbonell,  Ward 
and  Senders  (1968)  and  utility  based  decision  theory  (Sheridan  (1976^.  On  the 
surface  at  least  it  appears  that  these  theories  are  highly  specialized,  highly 
structured  and  difficult  to  integrate.  The  results  presented  here  will  show  that 
this  is  not  necessarily  the  case.  Each  is  simply  the  result  of  picking  a particu- 
lar type  of  mathematical  representation  as  the  vehicle  for  theory  construction 


and  modelling. 


Another  key  trend  which  is  found  in  the  literature  is  the  movement  away 
from  viewing  the  operator  strictly  as  the  pure  "black  box"  responding  invariantly 
to  stimuli  and  toward  viewing  him  as  an  adaptive  processor  of  information. 

Moray  (1976)  discusses  the  importance  of  this  view.  In  part  this  trend  reflects 
the  cognitive  nature  of  the  control  tasks  of  interest.  As  cogniti  jn  and  perception 
become  more  important  and  skill  at  motor  tasks  becomes  less  important  in  auto- 
mated systems,  engineering  theories  of  human  performance  will  undoubtedly 
align  themselves  with  some  of  those  in  cognitive  or  information  processing  psy- 
chology. As  noted  by  Kantowitz  in  the  preface  of  Kantowitz  (1974),  traditional 
control  theories  are  used  in  psychology  primarily  for  skill  tasks;  while  theories 
of  cognition  tend  more  toward  the  types  of  theories  used  in  computer  science, 
e.  g.  automata  theory.  Further,  some  emerging  theories  of  human  motion  anrl 
co-ordination  provide  some  very  fundamental  insights  into  the  ways  in  which 
humans  accomplish  these  very  complicated  control  tasks  without  excessive  pro- 
cessing requirements.  Turvey,  Shaw  and  Mace  (in  press),  Turvey  (1977)  and 
Greene  (in  press)  are  particularly  useful  in  this  regard. 

In  summary,  the  focus  of  manual  control  research  seems  to  be  moving 
away  from  theories  about  skill  oriented  tracking  tasks  toward  a view  of  the 
operator  as  an  adaptive  information  processor.  Most  of  the  engineering  theories 
so  far  put  forward  are  simply  direct  application  of  existing  highly  structured 
mathematical  forms  and  it  is  not  yet  clear  how  these  various  schemes,  ranging 
from  optimal  control  theory  to  queuing  theory,  can  be  integrated  to  provide 
some  cumulative  knowledge  applicable  to  a broad  class  of  man-machine  system 
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design  problems.  This  paper  puts  forward  a somewhat  formal  meta- theoretic 
analysis  of  the  general  adaptive  control  problem  with  the  hope  that  it  will  con- 
tribute to  a more  comprehensive  understanding  of  the  problems,  and  therefore, 
speed  integration  of  knowledge. 

In  the  next  section  a brief  discussion  of  the  concept  of  adaptation  is  pre- 
sented to  put  the  formal  analysis  in  some  perspective. 


k 


. The  Concept  of  Adaptation 

Berlinski  writes  "In  biology  and  in  the  social  sciences,  one  thinks 
of  adaptive  control  as  natural:  the  mechanisms  by  which  social  life  is  regu- 
lated, once  one  exludes  certain  artificial  cases,  inevitably  involve  adaptive 
processes , with  the  machinery  of  regulation  employed  in  a continuous  redef- 
inition of  the  regulated  process  itself. 1,1  The  statement  applies  as  well  to 
Individual  human  behavior.  Essentially,  adaptation  is  a very  natural  mode 
of  operation  and  the  unusual  event  is  its  absence.  It  is  therefore  surprising 
that  the  concept  is  not  better  understood. 

Gaines  (1972)  presented  a very  lucid  discussion  of  many  of  the  conno- 
tations of  the  terms  which  appear  in  the  literature.  In  particular,  he  discusses 
some  of  the  differences  between  structural  and  behavioral  definitions  of  the 
term  and  he  takes  the  point  of  view  that  adaptation  can  be  formalized  strictly 
on  behavioral  terms . In  this  regard  his  paper  is  a continuation  of  a long 

I 

standing  series  of  discussions  on  the  philosophical  foundations  of  the  concepts 

1 

of  goal  seeking  and  adaptation  dating  back  at  least  to  Wiener,  Rosenblueth, 
and  Bigelow  (1943)  and  the  foundations  of  cybernetics. 

The  debate  about  behavior  versus  structure  seems  to  revolve  around 
the  question  of  purpose.  Roughly  speaking  the  behavioral  view  of  adaptation 
argues  that  adaptive  behaviors  must  be  explained  without  recourse  to  specula- 
tion on  the  structure  of  the  acting  system.  Adaptation  in  this  view  is  therefore 
explained  solely  in  terms  of  the  responses,  more  correctly  the  inputs  and  out- 
puts, of  the  acting  systems.  Purpose  must  be  recognizable  solely  and  completely 
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from  the  Input- output  pairs  themselves  without  as  Weiner  states  "any  speculation 
on  the  structure  and  nature  of  the  acting  object.  "2 

The  opposite  view  posited  by  Taylor  in  response  to  the  cybernetic  view 
(see  Taylor,  1950)  and  discussed  by  Berlinski  (1976)  is  that  purpose  is  an  in- 
tentional concept  and  it  is  not  behavioristically  definable.  Berlinski  states 
"purpose  is  ordinarily  taken  as  an  intentional  concept  in  the  sense  that  some 
special  relationship  between  a purposeful  agent  and  the  object  of  his  actions  is 

O 

assumed  in  taking  goal  directed  action. . . " In  essence  this  school  of  thought 
argues  that  adaptive,  goal-seeking  behavior  cannot  be  discussed  without  some 
recourse  to  the  structure  and  organization  of  the  system  under  study. 

The  point  to  be  made  here  is  that  there  is  by  no  means  agreement  on  the 
definition  of  adaptation  nor  is  there  agreement  on  the  preferred  methods  for  its 
study.  It  is  the  view  of  this  author  that  the  structural  view  is  the  more  useful, 
particularly  for  the  task  of  constructing  engineering  theories  of  manual  control. 
Engineers  are  dealing  with  "artificial"  systems  (see  Simon,  1968),  systems 
designed  to  accomplish  certain  ends,  and  the  human  operator  happens  to  be  one 
component  in  these  systems.  The  objects  and  relations  needed  for  a model  of 
human  adaptive  behavior  should  (must)  incorporate  this  structural  information 
as  well  as  the  behavior  themselves.  Even  Gaines'  "adaption  automaton"  (see 
Gaines,  1972)  which  presumably  is  to  be  considered  an  embodiment  of  the  be- 
havioral adaptation  concept,  is  based  on  extra-behavioral  assumption.  Specif- 
ically the  response  of  the  controller  performing  a task  must  be  evaluated  via  a 
performance  measure  and  the  performance  classed  as  satisfactory  or  not 
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satisfactory.  The  automaton  output  behaviors  are  the  sequences  of  performance 
classifications.  A behavioral  description  has  been  given,  but  at  a level  of  anal- 
ysis one  step  removed  from  the  behaviors  of  the  controller  itself  and  with  the 
assumption  that  "adaptive  behavior  may  be  ascribed  to  an  adaption  automaton.  " 
The  point  is  not  to  criticize  Professor  Gaines'  important  contribution,  but  to 
point  out  that  it  is  exceedingly  difficult  to  formally  discuss  adaptation  without 
some  reference  to  the  overall  system  structure  and  some  discussion  of  why  it 
is  structured  that  way. 

With  this  material  as  background,  a formalization  of  control  problems, 
control  systems  and  adaptive  control  will  be  developed. 


4.  Control  Problems  and  Control  Systems 


Gaines  (1972)  lists  the  following  as  essential  to  the  discussion  of  adaptive 
systems:  1)  a controller,  2)  an  environment,  3)  a measure  of  performance  and 
4)  the  notion  of  change  over  time.  The  controller,  either  artificial  or  natural, 
interacts  with  the  environment  to  presumably  further  some  puspose.  The  mea- 
sure of  performance  is  the  means  by  which  this  interaction  is  evaluated.  The 
notion  of  change  over  time  is  essential  because  the  concept  of  adaptation  is  predi- 
cated on  the  change  of  behaviors  over  time. 

The  influence  of  control  theory  on  the  definition  of  these  elements  is  ob- 
vious. The  objective  in  this  section  is  to  present  some  general  types  of  objects 
and  relations  which  must  be  identified  when  control  systems  are  described  and 
control  problems  are  posed.  The  relationship  between  control  problems  and 
control  systems  is  examined  and  the  concept  of  adaptation  is  introduced  at  this 
point.  Discussion  of  the  implications  for  manual  control  are  deferred  to  the 
next  section. 

4. 1 Control  Problems  and  Controllers 

When  an  engineer  poses  a control  problem  he  has  in  mind  the  elements 
mentioned  earlier,  a controller,  an  environment  usually  thought  of  as  a plant 
to  be  controlled  and  some  set  of  performance  specifications,  if  not  a perfor- 
mance measure. 

In  its  simplest  form  the  problem  can  be  addressed  in  terms  of  two  struc- 
tures, some  representation  of  the  controlled  plant  and  a performance  evaluation 


structure.  These  are  usually  In  the  form  of  mathematical  functions  and  rela- 
tions (more  precisely,  they  are  usually  statements  about  such  mathematical 
structures).  The  controlled  plant  is  typically  characterized  in  terms  of  control 
inputs,  disturbance  inputs  and  output  responses.  A purely  behavioral  represen- 
tation of  the  plant  Is  then  a relation  S of  the  form 

S C X x W x Y (1) 

where 


X = 

{x  1 

x: 

T-»AX} 

w = 

{w  I 

w: 

T-»  a2  } 

Y = 

{y  1 

y: 

t-a3} 

The  set  T is  linearly  ordered  by  a binary  relation  denoted  by  < , has  the  struc- 
ture of  a monoid  (see  appendix)  with  binary  operation  A and  identity  tQ,  and 
represents  time.  The  sets  A2,  Ag  are  the  input,  disturbance  and  output 
spaces  respectively.  The  elements  of  these  sets  are  the  values  which  can  be 
taken  on  by  the  input,  disturbance  and  output  time  functions.  In  general  these 
sets  are  multi-dimensional  and  are  often  given  the  structure  of  vector  spaces. 

The  sets  X,  W and  Y,  which  are  used  to  define  the  relation  S,  contain 
as  elements  time  functions  which  represent  the  system  behaviors.  Clearly, 
an  element  of  S is  a triple  of  these  time  functions,  an  input  function  x and  dis- 
turbance function  w matched  with  the  corresponding  response  function  y.  Intui- 
tively then,  the  relation  S is  nothing  but  a listing  of  all  the  possible  behaviors 
of  the  system. 
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It  is  seldom  that  a control  problem  is  posed  using  a system  representa- 
tion as  general  as  the  relation  S.  At  a minimum  some  notion  of  time  causality 
and  state  determ  inacy  is  invoked.  Roughly  speaking  this  corresponds  to  the 
idea  that  the  plant  cannot  anticipate  future  inputs  in  advance  but  responds  instead 
only  to  past  inputs  and  further,  the  exhibited  behaviors  can  be  described  to  any 
desired  degree  in  terms  of  a finite  number  of  state  or  intervening  variables.  A 
formal  characterization  of  these  additional  properties  will  be  provided  shortly, 
but  some  additional  notation  is  needed  first. 

Let  tj,  t£  be  any  two  elements  in  T and  let  tj  < t2  where  < denotes 
the  relation  which  linearly  orders  T.  Then,  let 

^1^2  = { t I t € T,  t<  t£,  tj  < t } 

and  let 

^tit2  = Ttit2  u ^ tj  } . 

The  set  T t is  therefore  that  subset  of  T which  contains  points  "greater  than 
or  equal  to"  tj  but  "less  than"  t2.  Now,  consider  any  function  x € X.  A new 
function  x*  t can  be  constructed  by  restricting  the  domain  of  x to  the  set 
T^^.  Specifically,  for  the  given  function  x, 

*tit2  = {k  x(t))  1 € \t2*  X(t))  € X}* 

Then,  the  entire  set  of  functions  X can  be  so  restricted, 

^tit2  = 'C ^ ^1*  ^2  ^ ^1  ^ *•«>,  x € X }. 

Similar  notation  will  be  used  to  reference  the  restrictions  of  the  disturbance 


and  output  sets  as  necessary. 


Now,  state  determinancy  requires  that  the  relation  S be  constructively 
specified  in  terms  of  two  families  of  functions.  First,  let  F be  a set,  the  state 
space,  and  consider  the  two  following  functions: 


: F x Xtlt2  x Wtlt2  - F 

(2) 

: F x Aj  x Ag  -»  Ag 

(3) 

The  first  is  a state  transition  function,  the  state  at  time  tj  and  the  inputs  over 
the  time  interval  from  tj  to  t2  combine  to  give  the  state  at  time  t2.  The  second 
function  establishes  the  output  value  at  time  t given  the  state  and  inputs  at  time 
the  given  point  t.  In  the  general  case  there  is  a different  state  transition  func- 
tion for  each  pair  of  time  points  tj,  t2  € T and  there  is  an  output  assignment 
function  for  each  point  t 6 T.  Most  control  problems  are,  however,  posed  with 
at  least  time  invariant  systems  which  provides  some  simplification.  The  inter- 
ested reader  is  referred  to  Mesarovie  and  Takahara  (1975)  for  a more  complete 
discussion  of  these  points. 

The  relationship  between  the  system  S given  in  equation  (1)  and  the  con- 
structive specification  of  it  (equations  (2)  and  (3))  is  straightforward.  Essentially, 
all  behaviors  in  S are  constructed  using  (2)  and  (3)  in  the  sense  that  an  initial 
state  and  the  inputs  completely  determine  the  response.  For  purposes  of  this 
discussion  it  is  sufficient  to  say  the  following: 

(x,  w,  y)  e S if  and  only  if 

3 f e F 3 V t € T 
y(t)  = xt  (*t0t  & *t0t.  wtQt),  x(t),  w(t)) 
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In  other  words,  the  response  observed  at  time  t is  determined  by  the  starting 
state  f,  and  the  inputs  applied  over  the  interval  from  tQ  to  t. 

The  above  leads  very  naturally  to  a response  function  or  initial  state 
representation  of  the  relation  S.  Specifically, 

SF:  F x X x W -4  Y (4) 

where 

(f,  x,  w,  y)  € SF 

y = {(t,  y(t»  I t € t, 

y(t)  = xt  (%t  & xt0f  wt0t)»  "<*>)> 

Therefore,  the  response  y is  determined  by  the  initial  state,  the  control  input 
function  and  the  disturbance,  i.  e. , 
y = SF  (f,  x,  w) 

In  almost  all  cases  control  problems  start  with  some  description  of  the 
state  transition  and  output  assignment  apparatus  (equations  (2)  and  (3))  rather 
than  the  behavioral  representation  S or  functional  representation  Sp.  (This 
terminology  is  that  of  Zeigler,  1976. ) That  is,  difference  or  differential  equa- 
tions are  used  to  describe  properties  of  the  system  behaviors,  but  the  behaviors 
themselves  are  not  typically  given.  The  performance  structure  on  the  other 
hand  is  often  expressed  using  the  initial  state  representation  (4). 

The  performance  structure  is  easily  characterized  using  a generalization 
of  Mesarovic  et.al.  (1970).  Given  an  initial  state  representation. 


SF:  F x X x W -*  Y 


a performance  measure  is  a function  P, 

P:  FxXxWxY-»V  (5) 

where  V is  a linearly  ordered  set  (a  ’’value"  set).  P then  associates  a value 
with  each  appearance  of  the  system  (i.  e.  each  element  of  SF). 

In  addition  to  the  measure  of  performance,  in  many  problems  a "tolerance" 
function  and  satisfaction  relation  is  employed,  particularly  in  cases  where  opti- 
mization is  not  the  explicit  concern.  A tolerance  function  can  be  thought  of  as  a 
map 

TL  : F x W -♦  V.  (6) 

Some  value  is  assigned  by  the  tolerance  function  to  each  initial  state,  distur- 
bance function  pair.  This  value  can  be  thought  of  as  the  minimum  acceptable 
level  of  performance,  given  the  state  and  disturbance.  The  satisfaction  relata- 
tion  is  then  a binary  relation  on  V which  provides  the  means  of  comparing  the 
performance  level  with  the  tolerance  level.  In  general, 

SR  C V x V (7) 

but  the  specific  properties  must  remain  problem  dependent.  A specific  appear- 
ance (f,  x,  w,  y)  e SF  is  deemed  satisfactoiy  or  acceptable  if  and  only  if  the 
pair 

(P  (f,  x,  w,  y),  TL(f,  wj)  € SR. 

For  example.  If  the  set  V is  the  real  numbers,  and  SR  is  the  relation  less  than 
or  equal  to,  performance  is  satisfactory  if  and  only  if 
P (f,  x,  w,  y)  « TL  (f,  w) 
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The  general  statement  of  the  control  problem  can  now  be  made.  Given 


a representation  of  the  plant,  equation  (4);  a performance  measurement  struc- 
ture, equations  (5),  (6),  (7);  some  subset  of  the  possible  disturbance  functions, 
say  Wd  C W;  some  set  of  initial  states,  Fd  C F;  and  a set  of  allowable  con- 
trols, Xjj  C X;  find  a set  of  controls  Xa  where, 

' Xa  = { x | x € Xd,  V f € Fd, 

¥ w € Wd, 

(P(f,  x,  w,  y),  TL  (f,  w))  e SR  } 

The  set  Xg  contains  the  controls  which  for  any  initial  state  in  the  design  set 
Fd  and  for  any  disturbance  in  the  design  set  Wd  will  produce  satisfactory  per- 
formance. 

Almost  always  the  sets  Fj  and  Wd  are  highly  constrained.  For  example 
only  one  initial  state  and  a simple  class  of  disturbances,  perhaps  step  functions, 
are  used.  Also,  the  designer  usually  has  no  interest  in  enumerating  the  set  Xg 
but  rather  he  simply  wants  to  find  one  of  its  elements  assuming  that  there  is 
none. 

It  is  intuitively  obvious  that  in  almost  every  practical  control  problem 
the  set  Xs  as  presented  is  empty.  That  is,  it  is  impossible  to  find  one  control 
function  which  achieves  satisfactory  performance  with  all  initial  states  and  dis- 
turbances. This  is  in  part  a function  of  the  open-loop  nature  of  the  formulation, 
but  only  partly.  Optimal  control  problems,  for  example,  restrict  the  sets  Fd 
and  Wd  so  that  this  structure  is  formally,  but  not  necessarily  practically, 
meaningful. 
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A closed  loop  control  design  problem  differs  from  the  open  loop  problem 
in  the  information  assumed.  With  the  open  loop  problem  the  information  avail- 
able consists  of  the  plant  representation  SE  (equation  (4$),  the  performance 
structure,  (equations  (5),  (6),  (7))  and  the  design  sets  Fd,  W^,  The  closed 

loop  problem  is  the  same  except  for  the  specifications  of  the  set  of  accept- 
able controls.  In  the  closed  loop  case,  control  responses  are  presumed  to  be 
generated  by  state  determined  dynamic  systems  whose  inputs  are  plant  responses. 
Formally,  consider  the  family  of  systems  (controllers) 

CN  = {CE  | CE  : E x Y -»  X } (8) 

Y and  X are  as  defined  in  the  specification  of  S (see  equation  (1)) . E is  a con- 
troller state  space.  Each  system  in  CN  is  assumed  to  be  constructively  speci- 
fied with  state  transition  functions  and  output  assignment  functions  of  the  form 


rtlt2  ’ E * Yue2  - E 

(9) 

nt  : E *A3  - A1 

(10) 

Note  well  that  each  controller  would  in  general  have  its  own  unique  set  of  state 
transition  and  output  assignment  functions,  including  (possibly)  a unique  state 
space  E. 

The  idea  behind  the  closed  loop  controller  is  that  the  controlled  plant  and 
the  controller  are  interconnected  with  the  controller  output  input  to  the  plant 
and  information  about  the  plant  output  input  into  the  controller.  This  means 
that  in  operation  the  behaviors  of  both  controller  and  plant  are  highly  restricted 
and  control  actions  are  thereby  responsive  to  the  current  situation.  To  formally 


capture  this  for  purposes  of  this  discussion,  a feedback  composition  Sc  of  the 
two  systems  SE  and  CE  is  used, 

ScCFxExWxY 

= { (f,  e,  w,  y)  | 3 x e X 5 

(f,  x,  w,  y)  € Sc  /\  (e,  y,  x)  € CE  } 

Given  that  both  Sp  and  CE  are  assumed  to  be  state  determined,  it  easily  follows 
that 

Sc  : F x E x W -»  Y.  (11) 

So,  in  the  closed  loop  case,  the  plant  response  depends  only  on  the  disturbance, 
the  controller  initial  state  and  the  plant  initial  state. 

Now,  the  controller  design  problem.  To  each  controller  in  the  set  CNd 
will  correspond  to  a closed  loop  system  of  the  form  (11).  A given  controller 
would  be  classed  acceptable  if  V f e Fd,  V w € Vd,  Vet  Ed, 

(P  (f,  CE  (e,  y),  w,  Sc  (f,  e,  w})  , TL  (f,  wj)  € SR. 

That  is,  if  performance  is  acceptable  for  all  initial  conditions  and  disturbances 
in  the  design  sets.  Note  that  E^  C E is  the  set  of  controllers  initial  states 
considered.  The  control  problem  is  to  find  some  controller  in  CN^  which  has 
these  properties. 

The  successful  solution  of  a control  problem  results  in  a functional  repre- 
sentation of  the  controller.  This  provides  a fairly  complete  description  of  the 
types  of  behaviors  that  the  controller  must  exhibit  when  realized.  Notice  that 
in  this  form  the  controller  D does  not  solve  control  problems,  rather  it  is  a 


control  problem  solution. 


Further,  it  is  extremely  important  to  note  that  the  control  problem  is 
solved  in  terms  of  some  behavioral  or  functional  representation  of  the  plant, 
not  the  plant  itself.  If  these  structures,  i.  e.  plant  and  controller  representa- 
tions, are  in  the  same  equivalence  class  as  the  behaviors  of  the  plant  and  the 
controller  which  is  ultimately  realized,  then  actual  performance  will  be  accept- 
able as  long  as  the  design  conditions  are  not  violated  (disturbances  within  the 
class  designed  for).  Should  the  actual  disturbance  not  be  equivalent  to  an  ele- 
ment of  the  design  set,  or  should  the  plant  representation  used  for  design  turn 
out  not  to  be  behaviorally  equivalent  to  the  plant,  the  controller  realized  from 
the  control  problem  solution  will  then  not  necessarily  produce  acceptable  per- 
formance. 

The  final  observation  to  make  here  concerns  this  relationship  between 
the  control  problem  and  the  state  determined  controller  behaviors  which  result. 

In  essence,  the  final  product  of  the  control  problem  is  a controller  which  pre- 
sumably realizes  the  properties  defined  by  equations  (9)  and  (10),  i.  e.  a sys- 
tem which  processes  information  in  a pre-specified  way.  Clearly,  it  is  con- 
structed in  this  way  so  that  the  control  objectives  will  be  achieved  in  at  least 
those  situations  considered  during  design.  But,  this  system  has  very  little 
flexibility.  Controller  state  changes  follow  from  the  organization  of  the  "mechan- 
ism" and  the  information  received  from  the  environment,  i.  e.  the  plant  response. 
The  controller  does  not  have  the  means  to  modify  the  rules  of  transition,  i.  e. 
to  modify  the  functions  T and  fi  listed  in  equations  (9)  and  (10).  Conceptually, 
but  not  practical fy,  an  all  encompassing  control  problem  might  be  envisioned 


and  the  resulting  solution,  if  it  could  be  obtained,  would  result  in  a controller 
with  a state  space  sufficiently  "rich"  that  each  context  or  each  environmental 
situation  would  be  properly  handled.  In  terms  of  practical  design  this  is  impos- 
sible without  further  decomposition  of  the  control  problem.  The  usual  notions 
of  adaptive  control  provide  this  decomposition. 

4. 2 Adaptive  Control,  Some  Preliminaries 

A brief  review  of  the  previous  section  will  show  that  a control  problem 
and  its  closed  loop  solution  involves  three  different  types  of  structures, 

EC  = (SF,  Fd,  Wd) 

G = (P,  TL,  SR) 

CN  = {(CE,  Ed)  | CE  € CNd,  Ed£E} 

The  first,  EC,  constitutes  a particular  view  of  the  controller's  environment 
expressed  in  terms  of  a plant  representation  SF,  a set  of  initial  states  Fd  and 
a set  of  exogenous  disturbance  functions  Wd.  EC  can  be  viewed  as  the  "context" 
in  which  the  controller  is  to  operate.  The  second  structure,  G,  is  the  perfor- 
mance evaluation  structure  or  goal  structure  which  is  used  to  determine  the  ac- 
ceptability of  the  possible  controllers  in  the  given  context.  The  last,  CN,  con- 
sists of  the  allowable  controllers  paired  with  the  design  initial  states. 

The  design  task  can  be  summarized  as  follows:  given  a specific  triple 
(EC,  G,  CN),  find  some  element  of  CN  which  is  evaluated  as  acceptable  by  the 
goal  structure  G in  the  context  EC.  If  CN*  denotes  that  subset  of  CN  which 
contains  acceptable  controllers,  the  task  then  is  to  find  one  of  the  elements  in 
CN*  and  implement  it. 
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In  the  non-adaptive  case  this  would  be  the  end  of  It.  A controller  In  CN*, 
If  one  exists  and  is  found,  is  implemented  and  things  presumably  work  as  in- 
tended. In  the  adaptive  case,  however,  the  context,  or  perhaps  the  goal  struc- 
ture, changes  over  time  and  the  control  system  is  expected  to  compensate  for 
this  change.  Adaptive  controllers  can  therefore  be  thought  of  as  systems  which 
are  designed  to  solve,  over  time,  control  problems  from  some  class  of  problems 
rather  than  simply  realize  one  single,  well  specified,  problem  solution. 

To  formalize  this,  let  £ denote  a set  of  control  contexts,  ^ a set  of 
goal  structures,  and  £ a set  whose  elements  are  sets  of  controllers  and  their 
design  initial  states. 

The  elements  of  £ are  specific  contexts  EC  = (SF,  Fd,  Wd);  elements 
of  4 are  goal  structures  G = (P,  TL,  SR);  and  elements  of  C are  sets  of  al- 
lowable controllers  CN.  A control  problem  can  then  be  viewed  as  a triple 
(EC,  G,  CNd)  e £x  -4x  C. 

Some  consistency  conditions  must  be  imposed  if  the  problems  are  to  be 
well  posed.  Note  that 

(EC,  G,  CNd)  = ((SF,  Fd,  Wd),  (P,  TL,  SR),  CN<J 

and  recall  that 

SF  : F x X x W -»  Y 
P : FxXxWxY-»  V 
TL  : F x W -*  V 
SR  C V x V. 
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Also,  note  that  elements  C of  CNj  are  relations  of  the  form,  (CE,  Ed), 

CE  : E x Y -♦  X 

A problem  (EC,  G,  CN)  is  said  to  be  well  posed  if  its  components  are 
all  defined  on  the  same  objects  F,  X,  W,  Y and  V and  Fd  C F,  Wd  C W, 

Ed  Q E.  In  other  words,  the  plant  representation,  goal  structure  and  controller 
representations  must  all  be  relations  on  the  same  objects. 

A class  of  well  posed  control  problems  may  then  be  thought  of  as  a rela- 
tion 

-JQ  £ x Ct  (12) 

elements  of  which  are  well  posed  problems  (EC,  G,  CN). 

Similarly,  the  problem/ acceptable  solution  relation  can  be  de- 

fined as  follows: 

« { (EC,  G,  CN*)  | (EC,  G,  CN*)  e 

and  (C,  Ed)  € CN*  =>  satisfactory 
performance  under  (EC,  G)  } (13) 

Asa  relation  then,  -*/*  pairs  the  context  and  goal  structure  with  those  allowable 
controllers  which  produce  satisfactory  performance. 

Using  J as  a base,  the  adaptive  control  problem  can  be  thought  of  in  the 
following  terms.  At  specified  instants  in  time  (perhaps  continuously)  the  proper 
element  of  J is  identified,  i.  e.  a control  problem  is  defined.  The  system  then 
finds  a solution  and  implements  it.  The  solution  selected  and  implemented  will 
not  necessarily  yield  satisfactory  performance,  but  over  time,  as  experience 
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with  the  set  of  tasks  is  accrued,  proper  solutions  are  eventually  achieved.  In 
other  words,  as  experience  is  gained,  the  problem  base  moves  from  'J  to  */*. 

Gaines  (1972)  seems  to  have  this  type  of  operation  in  mind  when  he  makes 
a strong  case  for  axiamitizing  adaptation  in  terms  of  tasks.  He  describes  a task 
to  be  ”...  same  specification  of  plant  parameters,  initial  conditions  and  period 
of  interaction,  together  with  a tolerable  performance  level  above  which  a control 
policy  is  considered  satisfactory."4  His  notion  of  a task  then  can  be  interpreted 
as  a control  problem,  a means  of  measuring  the  level  of  performance  of  an  im- 
plemented policy,  and  the  means  to  classify  this  performance  as  acceptable  or 
not  acceptable.  The  basic  objects  and  relations  which  characterize  the  adaptive 
controller  will  be  shortly  be  described  in  these  terms.  But  first,  same  relation- 
ships between  the  time  sets  used  for  control  problem  representation  and  the  time 
set  of  the  adaptive  controller  must  be  examined. 

4.  3 Implementation  Time  and  Task  Time 

The  notion  that  past  experience  is  used  to  change,  and  hopefully  improve, 
control  strategy  seems  essential  to  any  theory  of  adaptation.  To  get  some  pic- 
ture of  the  implications  of  this,  some  of  the  technicalities  of  time  sets  must  first 
be  addressed. 

Recall  that  the  plant  representation  Sp  is  defined  on  sets  of  time  func- 
tions and  these  time  functions  have  as  domain  some  linearly  ordered  set  T (see 
equation  (1)  in  the  previous  section) . This  set  is  presumably  a representation 
of  some  of  the  properties  of  real  time.  In  terms  of  the  control  problem,  the 
identity  element  in  T,  namely  t0,  is  usually  interpreted  as  standing  in 
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correspondence  with  that  point  in  real  time  at  which  the  controller  starts  to  per- 
form its  assigned  task,  l.  e.  the  point  in  time  at  which  the  solution  is  imple- 
mented. A more  general  view  would  consider  tQ  as  standing  in  correspondence 
with  several  real  time  points,  those  being  task  starting  points  in  the  sense  of 
Gaines  (1972).  If  the  controller  is  turned  on  and  left  to  run  into  the  indefinite 
future,  the  first  view  is  perhaps  more  appropriate.  But  even  fixed  structure 
control  systems  are  considered  to  operate  under  some  notion  of  invariance 
where  activities  over  different  intervals  of  time  are  construed  as  being  essen- 
tially the  same.  In  other  words,  the  tasks  are  the  same  except  they  are  per- 
formed at  different  points  in  time. 

To  provide  a more  precise  characterization,  let  TR  serve  as  a time 
set  representing  the  implementation  time  set  (real  time)  and  let  T,  as  before, 
denote  the  time  set  used  in  posing  the  control  problem.  It  is  necessary  to  as- 
sume that  there  is  a binary  operation  + defined  on  TR  and  a binary  operation 
A defined  on  T such  that  the  structures  <T p,  +>  and  < T,  A>  are  both 
monoids  (see  appendix  for  a list  of  properties).  Let  0 € TR  denote  the  identi- 
ty element  of  the  first  structure  and  tQ  the  identity  element  of  the  second.  Now, 
consider  a map  (homomorphism) 

h : T Tr  (14) 

with  the  properties  that 

V tj,  t2  € T h(tx  At2)  = h(tx)  + h(t2) 

h <tQ)  = 0. 
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Now,  consider  a map 

m : x T -*  Tj^  (15) 

defined  such  that  V t € TR,  V t € T 
m ( r,  t)  = r + h(t) 

The  homomorphism  h preserves  interval  information  and  m provides  the 
means  by  which  points  in  T can  be  interpreted  in  the  set  tr. 

Points  in  T,  therefore,  should  be  viewed  as  relative  times  with  an  ele- 
ment t denoting  the  time  after  start  of  operation  on  a task.  The  map  m then 
provides  the  proper  implementation  time  Interpretation  given  the  task  starting 
time  t . The  set  TR  is  then  the  natural  set  to  use  for  description  of  the  be- 
haviors of  the  adaptive  controller. 

Finally,  in  terms  of  the  notions  described  in  the  previous  section,  task 
starting  times  form  same  subset  of  the  points  in  T^,  say  Tg  C Tr.  The  points 
in  TE  then  mark  those  points  in  times  at  which  the  controller  structure  can 
change.  It  is  not  necessarily  the  case  that  TE  is  denumerable,  but  if  it  is  not 
the  implication  is  that  the  task  definition  is  continuously  changing  over  some  in- 
terval of  time.  The  denumerable  assumption  is  made  here. 
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4.  4 A Description  of  an  Adaptive  Controller 

Adaptive  control  will  here  be  described  in  terms  of  a two-level  system. 

The  lower  level  at  any  Instant  in  time  is  the  realization  of  a controller  of  the  type 
specified  by  equations  (9)  and  (10).  The  upper  level,  the  adaptor,  is  the  part  of 
the  overall  system  responsible  for  adjusting  the  lower  level.  It  operates  on  an 
information  pattern  consisting  of  past  plant  and  controller  responses  and  produces 
lower  level  controllers  as  outputs. 

Roughly  speaking,  the  evolution  of  an  adaptive  response  can  be  thought  of 
in  terms  of  a sequence  of  activities  including  a control  problem  statement,  deter- 
mination of  the  solution  (L.  e. , specification  a controller),  implementation  of  the 
solution,  performance  of  the  task  by  the  controller,  assessment  of  the  performance 
by  the  adaptor,  and  then  redefinition  of  the  control  problem  for  the  next  task.  This 
scheme  could  operate  in  a number  of  different  ways.  Task  duration  could  be  fixed 
or  variable.  For  example,  performance  evaluation  could  be  continuous  and  the 
task  terminated  when  performance  falls  below  3ome  specified  level. 

The  respecification  of  the  next  control  problem  (next  task)  could  involve 
activities  as  simple  as  modifying  the  design  disturbance  set  W^,  or  perhaps  both 
and  F^.  It  could  also  involve  a redefinition  of  the  plant  model  Sp.  This  might 
simply  be  the  respecification  of  the  function  Sp  on  the  same  objects  (i.  e. , the 
set  X,  W,  Y,  F)  or  it  might  involve  some  change  in  objects  as  well. 

A less  common,  but  legitimate  type  of  adaptation,  particularly  for  human, 
social  and  political  systems,  is  some  change  in  the  goal  structure  G.  The  system 
might,  for  example,  learn  over  time  that  certain  performance  levels  are  simply 
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not  attainable  with  the  resources  available.  The  set  of  allowable  controllers  CN 
might  then  be  changed  to  allow  achievement  of  the  desired  performance  level. 

In  principle  then  there  is  no  apriori  reason  to  restrict  the  adaptor  to  act  on 
one  specific  type  of  object,  particularly  since  manual  adaptive  control  is  the 
ultimate  aim.  The  adaptor  is  therefore  assumed  to  be  operating  on  the  class  of 
well  posed  control  problems  S.  The  information  pattern  is  assumed  to  be  past 
plant  response  and  past  controller  behavior  and  the  adaptor  output  behavior  is  a 
sequence  of  controllers  which  are  intended  to  solve  the  control  problems  posed 
in  the  sequence  of  tasks. 

The  observable  behavior  of  an  operating  adaptive  system  generally  will  not 
explicitly  include  a description  of  the  tasks.  (This  it  seems  is  a main  point  of 
those  arguing  against  a strictly  behavioral  veiw  of  adaptation  and  purposive  be- 
havior. ) But,  before  presenting  a description  of  the  objects  upon  which  the  adap- 
tor can  be  defined,  a brief  characterization  of  the  task  sequence  and  the  resulting 
controller  sequence  will  be  presented.  This,  hopefully,  will  provide  a clearer 
view  of  the  operation  of  an  adaptive  system  than  a pure  input-output  description. 

Each  task  faced  by  the  adaptor  is  assumed  to  be  an  element  of  the  class  of 
tasks  'i  (see  equation  (12)  ).  The  time  set  upon  which  the  adaptor's  behavior  are 
defined  is  the  set  TR,  implementation  time,  and  controller  implementation  times 
are  the  elements  of  the  "event"  time  set  TR  C TR.  The  task  sequence  is  then 
conveniently  thought  of  in  terms  of  a function 

Y:  Te-W  (16) 

A pair  (t,  Y (t)  ) 6 d consists  of  the  task  starting  time  t and  the  specific  task 
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Y (t)  e J which  is  in  effect  at  that  time.  Note  that  Y(t)  is  a triple  of  structures. 


Y(t)  = [ EC*  G*  (CNd)t] 

where  the  subscript  t is  used  to  denote  the  event  time  dependence.  The  structure 
EC  , for  example,  denotes  the  control  context  at  time. 

I 

Parallel  to  the  sequence  defined  by  (16)  is  another  sequence 

Y*  : (17) 

where  [t,  (CE*  G*  CNt*)  ] E Y*  If  and  only  if  CN£  is  the  acceptable  subset  of 
(CN(j)t  given  CEt  and  G*  and  [t,  (CE*  G*  (CNd)t)  ] 6 Y.  Y*,  therefore,  is  the 
task  sequence  but  with  the  set  of  allowable  controllers  replaced  by  the  set  of  satis- 
factory controllers.  From  the  set  CNj*  is  selected  the  controller  implemented  at 
time  t. 

An  output  behavior  of  the  adaptor  is  a function 

C * : Te  - CN  (18) 

defined  by  the  following  conditions: 

(t,  Ct)  £ C * =>  Ct  G CNt* 

[t,  (CEt,  G*  CNt*  )]g  Y*. 

At  best  only  C*  would  be  observable.  The  functions  Y and  Y*  would  almost 
never  be  explicitly  displayed,  but  conceptually  they  must  underlie  the  observed 
sequence  of  controllers. 

Before  turning  to  the  adaptor  itself,  a few  additional  observations  should  be 
made.  First,  the  above  functions  (16),  (17),  and  (18)  all  refer  to  single  behaviors, 
i.  e. , one  single  response  over  time.  The  range  of  behaviors  possible  is  determined 
by  the  set  of  possible  task  sequences  and  it  is  very  broad.  In  general,  the  set  TE 

1 . 

L 


31 


is  different  for  each  possible  behavior  (unless  task  durations  are  fixed)  and  the 
occurrence  of  task  start  events  is  determined  in  part  by  the  actual  plant  behaviors. 
Also,  the  task  sequence  which  defines  a given  behavior  presumably  will  reflect 
the  learning  (or  lack  thereof)  which  takes  place.  That  is,  the  task  definition 
at  time  t,  and  hence  the  controller  implemented  at  t,  will  be  a function  of  those 
controllers  previously  implemented  and  their  behaviors  on  the  previous  tasks. 

The  point  is  that  the  task  sequence  and  the  sequence  of  controllers  evolves 
over  time.  This  evolution  is  restricted  only  by  the  alphabet  of  tasks  J and  the 
rules  under  which  the  adaptor  operates. 

The  inputs  available  to  the  adapter,  as  stated  above,  are  past  plant  and  con- 
troller responses.  These  are  functions  defined  on  the  time  set  T^,  but  it  is 
simpler  and  more  clear  to  consider  them  as  a special  concatenation  of  functions 
defined  on  T and  used  in  the  representation  of  the  plant. 

It  is  here  assumed  that  the  set  Tg  C T^  and  the  set  T are  related  in  the 
following  way.  Let  ta  and  t^  be  two  adjacent  points  in  Tg,  i.  e. , ta<  t^  and  3 no 
element  t'  E T^  3 (ta  < t’  and  t'  < t^),  then  there  exists  a point 
s E T 3 ^ = m(ta,  s)  where  m is  defined  by  equation  (15).  Equivalently, 
tjj  = ta  + h(s).  In  other  words,  task  durations  are  assumed  always  to  stand  in 
correspondence  with  some  element  of  T.  Now,  if  ta,  t^  are  successive  task 
starting  times,  the  corresponding  interval  in  T is  then  T^  where  t^  = m(ta,  s). 
Since  all  intervals  in  this  representation  start  at  the  point  tQS  T,  for  notations! 
simplicity  explicit  dependence  on  tQ  will  be  dropped.  Therefore 


T — T 
t s ~ 8 
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With  this  notation,  the  information  available  to  the  adaptor  upon  completion 

of  a task  of  duration  s is  a pair  of  functions  (xs,  yg)  E Xg  x Yg.  The  first  repre- 
sents the  controller  response,  the  second  the  plant  response.  Note  that  the  func- 
tions (xg,  yg)  are  in  some  sense  an  internal  representation  used  by  the  adaptor. 
That  is,  they  represent  an  encoded  version  of  the  actual  responses. 

Now,  if  D denotes  the  state  space  of  the  adaptor,  the  behavior  of  the  adap- 
tor from  task  to  task  can  be  described  in  terms  of  a family  of  functions  of  the 


iltg  : D x Xg  x Yg  D (20) 

Vt  : D -*•  CN  (21) 

where  t E T^  is  the  task  starting  time,  s E T is  the  task  duration. 

In  the  usual  fashion,  equations  (20)  and  (21)  can  be  used  to  trace  the  re- 
sponse of  the  adaptor  over  time,  and  hence  trace  the  evolution  of  the  controller 
as  well.  Suppose  the  process  starts  at  some  time  lle  TR  with  the  adaptor 
placed  in  the  state  d1  E D.  The  controller  implemented  at  time  tj  is  then  deter- 
mined by  equation  (21), 


ctj  = \ «v- 


Presuming  the  first  task  to  be  of  duration  Sj  E T,  the  starting  time  of  the 


second  task  is 


t2  = m(tlt  S!) 
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and  after  completion  of  the  first  task  the  plant  and  controller  responses  (x_  , y ) 

1 1 

will  be  available.  The  adaptor  state  at  this  time  is 

. d2  * ill1Sl  <dl*  \ • V 
and  the  new  controller  is 

Ct  = Tt  (d2). 

2 2 

This  process  then  continues  indefinitely. 

Clearly,  the  function  C*  mentioned  earlier  (see  equation  (18)  ) can  be  con- 
structed in  this  manner.  Also,  underlying  the  function  C*  is  a state  trajectory, 
say  Z*, 

Z*  : TE  -*D  (22) 

which  has  the  property  that 

c‘i  = At,  <z*  <V » • 

Note,  Z*(t^)  £ D is  the  adaptor  state  at  time  t^  The  adaptor  state  trajectory 
therefore  determines  the  controller  trajectory. 

Recall  that  it  was  argued  earlier  that  the  controller  trajectory  C*  followed 
from  the  sequence  of  tasks  (i.  e. , control  problems)  and  that  this  sequence  re- 
flected past  experience.  The  state  determined  view  provided  by  equations  (20) 
and  (21)  provides  a complementary,  but  somewhat  more  abstract  interpretation 
of  this  process.  The  adaptor  states,  the  elements  of  D,  are  an  abstraction  of 
the  means  by  which  tasks,  and  the  past  experiences  of  the  adaptor  with  tasks, 
are  encoded.  Some  representation  of  the  task  in  effect  at  time  t,  (ECt,  Gt.  (CN&)^, 
presumably  is  encoded  in  the  state  at  time  t as  is  knowledge  gained  from  past  tasks 
and  any  diagnostic  or  strategic  information  used  to  guide  the  adaptor.  The  adaptor 
states  therefore  represent  all  of  the  factual  information  available  to  the  adaptor. 
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Also,  with  this  type  of  interpretation  of  the  adaptor  states,  the  output 


assignment  function  “V  (see  equation  (20))  can  be  viewed  as  a behavioral  descrip- 
tion of  the  control  problem  solution  process.  It  converts  the  factual  and  proced- 
ural information  encoded  in  the  state  into  a controller  which  is  expected  to  satis- 
factorily perform  the  task. 

The  state  transition  function  (20)  embodies  a number  of  activities  includ- 
ing the  processes  by  which  the  control  task  definition  is  modified  given  the  be- 
havior observed  on  the  previous  task.  The  evaluation  of  the  controller  response 
to  assess  the  acceptability  is  presumably  accomplished  here  as  well. 

It  is  very  important  to  note  the  level  of  description  implied  by  equations  (20) 
and  (21).  A family  of  state  transition  and  output  assignment  functions  so  defined 

provides  only  sufficient  structure  to  provide  a causal  description  of  the  observed 
ft 

behaviors.  The  procedure  by  which  these  functions  are  computed  or  otherwise 
realized  is  not  explained  by  the  functions  themselves.  In  most  practical  systems 
not  involving  a human  operator  some  set  of  rules  is  used  to  specify  how  control 
problem  (task)  modifications  are  to  be  made.  Also,  some  procedure  for  solving 
the  control  problem  is  specified  and  together  these  sets  of  rules  define  (20)  and 
(21).  The  key  point,  however,  is  that  the  behavioral  description  of  (20)  and  (21) 

-1 

in  no  way  depends  on  the  specific  scheme  of  inplementation. 

Another  point  of  interpretation  should  be  made.  Equation  (20),  the  adaptor 


state  transition  function,  was  constructed  under  the  assumption  that  the  task  dura- 
tion was  a constant  s.  There  is  absolutely  no  difficulty  in  treating  s as  a variable 


the  adaptor  state  s units  into  a task  which  started  at  time  t in  state  d and  received 
information  (xfl,  yg).  Tasks  can  be  of  indefinite  length  in  this  formulation,  with 
the  end  of  a task  triggered  whenever  certain  states  are  entered.  These  states 
presumably  would  be  those  for  which  the  output  assignment  function  (21)  specifies 
a new  controller. 

In  summary,  the  adaptor  is  described  by  two  families  of  functions, 

1 DxX,xYs  -D  (20) 

Vt  : D — CN  (21) 

where  t E Te  C Tr  and  sET.  These  functions  establish  the  sequence  of  con- 
trollers C*  in  terms  of  a starting  state  and  the  observed  controller  and  plant 
response  on  the  previous  tasks.  The  adaptor  states  are  presumed  to  be  some 
encoded  representation  of  control  tasks  plus  additional  experiential  and  strategic 
information.  The  remaining  objects  Xg,  Yg  are  segments  of  the  input  and  output 
sets  used  in  the  plant  representation  and  here  represent  the  possible  information 
available  to  the  adaptor. 

4. 5 The  Performance  of  the  Adaptor 

Before  moving  to  a discussion  of  the  problems  of  modelling  manual  adap- 
tors, a very  brief  discussion  of  the  performance  of  the  adaptor  is  presented.  For 
purposes  of  discussion  it  is  assumed  that  a sequence  of  k tasks  starting  at  time 
ti  E Tr  is  performed.  The  tasks  are  of  durations  Sp  s2,  s3,  . . . , sk>  respectively. 
The  event  times  for  this  sequence  are  therefore 

te  = I 4i  | t1+i  = m(tif  Sj),  1 4 i 4 k-1,  given  J . 
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The  adaptor  is  assumed  to  start  in  some  state  dj  £ D,  and  the  plant  in 
some  state  fj  £ F.  The  disturbance  sequence  which  impacts  the  plant  during  the 


task  sequence  is  denoted  by  Wg^,  ws^  . . . , ws^  . 

The  first  controller  selected  by  the  adaptor  follows  from  equation  (21) 

and  the  given  information 

C - TTt  (dj). 

1 1 

Now,  Ct  is  a controller  specification  and  a set  of  initial  states,  say  (CE  , E. ). 

1 1 

Assume  that  is  the  actual  initial  state  implemented. 

The  closed  loop  system  will  then  generate  behaviors  x~  , y such  that 

1 S1 

* sf  < '!■  \-  wSi  > 

\ = cEl<  ci-  ySi  > 

At  the  end  of  the  task  the  plant  is  in  some  state,  say  f . The  adaptor  state  at  the 
end  of  the  task  is 


d2  ’ <di.  ) 

and  the  next  controller  follows  from  (21) 


Ct  = ^t  <d2>* 

2 2 

The  next  pair  of  task  behaviors  x , y are  then  produced  by  the  plant  and 

2 S2 

controller 

V = SF  < h-  V "s,  > 


*«„  - ce„  < c2*  y.  ) 


2 ~2 
s. 


and  so  on. 

Upon  completion  of  all  k tasks,  the  adaptor  will  have  passed  through  a 
sequence  of  states  dj,  d2, . . . dk  and  behaviors  (x^,  y^),  (x^,  y ), . . . (x^,  y ) 
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will  have  been  observed.  The  question  is,  do  these  behaviors  exhibit  adaptation? 
Or  in  other  words,  did  the  adaptor  perform  acceptably? 

Notice,  the  controller  selected  at  any  point  tj  G T£  is  satisfactory  in  the 
sense  that  it  is  a satisfactory  solution  of  the  control  problem  posed  at  that  point. 
Given  the  state  of  knowledge  at  tj,  i.  e. , given  the  state  of  the  adaptor,  the  selected 
controller  is  expected  to  perform  adequately.  But,  it  need  not  necessarily  so  per- 
form for  a number  of  reasons.  For  example,  the  actual  plant  may  not  sufficiently 
correspond  to  the  representation  used  by  the  adaptor  or  the  actual  initial  state  or 
the  actual  disturbance  might  not  be  in  the  design  set.  So,  the  behaviors  observed 
on  any  task  may  not  be  classed  as  satisfactory  even  though  the  controller  used  on 
the  task  was  thought  to  be  acceptable  at  the  start. 

In  order  to  evaluate  adaptor  performance,  a family  of  functions 

EVS:  DxXsxYs  -Va,  (23) 

where  s G T,  must  be  considered.  D,  Xg,  Ys  are  as  used  above  and  Va  is  the 
value  set  for  performance  evaluation.  Performance  on  a given  task  is  classed 
as  acceptable  if  the  observed  performance  value  is  an  element  of  a specified 
set  V*  C Va.  With  the  structure,  performance  on  a task  is  determined  by  the 
adaptor  state  at  the  start  of  the  task  and  the  observed  behaviors  when  the  task  is 
performed. 

The  evaluation  functions  EV  defined  above  presumably  incorporate  knowl- 
edge of  the  goal  structure  G used  in  defining  the  task  and  they  measure  the  degree 
to  which  the  goals  were  achieved.  Also,  the  adaptor  state  transition  functions  in 
general  would  incorporate  some  form  of  the  evaluator  functions  in  updating  exist- 
ing knowledge  of  plant  and  plant- controller  interactions. 


38 


Whether  or  not  the  adaptor  works  successfully  or  not  is  a function  of  the 
evaluations  over  the  entire  sequence  of  tasks.  Gaines  (1972)  discusses  a number 
of  modes  of  adaptation,  all  of  which  could  be  interpreted  here.  Suffice  it  to  say 
that  failure  to  perform  successfully  on  any  given  task  does  not  necessarily  mean 
unacceptable  adaptor  behavior.  The  successful  adaptor  would,  in  general,  be 
required  to  eventually  achieve  satisfactory  performance  on  some  proportion  of 


Implications  for  Manual  Control  Research 


The  types  of  objects  and  relations  needed  to  define  and  discuss  adaptive 
control  have  now  been  presented.  Roughly,  these  correspond  to  an  adaptor  and 
a family  of  control  tasks.  Each  control  task  consists  of  a control  context,  a 
goal  structure,  and  a set  of  allowable  controllers.  The  control  context  is  some 
plant  representation  together  with  sets  of  specified  initial  states  and  disturbances 
to  be  used  for  design.  The  goal  structure  consists  of  a performance  function, 
tolerance  function  and  satisfaction  relation.  Hie  adaptor  is  an  information  pro- 
cessing system  which  essentially  modifies  task  definitions  based  on  past  be- 
haviors and  produces  as  output  the  controller  for  the  current  task.  It  is  defined 
in  terms  of  family  of  state  transition  functions  which  establish  how  the  current 
task  performance  affects  the  state  of  knowledge,  and  output  assignment  functions 
which  produce  controller  specifications  from  the  current  knowledge  state.  A 
family  of  evaluator  functions  is  required  for  an  observer  to  assess  the  perfor- 
mance of  the  adaptor. 

It  was  further  argued  that  three  time  sets  are  useful  in  discussing  adap- 
tion. TD,  implementation  time,  is  the  most  basic  and  may  be  thought  of  as  real 
time.  Tg  is  an  event  time  base  denoting  task  starting  times.  T is  a relative 
time,  or  within  task  time,  which  is  most  convenient  to  use  in  describing  plant 
and  controller  behaviors.  The  observable  behaviors  of  the  adaptor  operate  on 
Tg,  in  fact  in  general  they  define  Tg. 

It  was  argued  in  the  introduction  that  humans  are  used  in  many  sophis- 
ticated control  systems  for  their  ability  to  adapt  and  provide  context  sensitive 
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control.  That  la,  the  human  la  In  the  system  to  be  the  adaptor  although  he  may 
well  be  the  controller  as  well.  The  reason  for  his  use  rather  than  some  artific- 
ially Intelligent  system  la  usually  because  the  designer  has  incomplete  knowledge 
of  the  set  of  tasks.  That  Is,  the  class  d (equation  (12)  ) cannot  in  general  be 
sufficiently  defined  to  allow  an  engineer  to  specify  and  realize  an  adaptor  which 
will  adequately  function  in  complex  environments.  Since  the  human  is  very  good 
at  certain  types  of  these  tasks,  he  can  provide  acceptable  adaptive  performance 
where  an  artificial  system  cannot.  In  a sense  then  the  human  is  the  engineer's 
way  of  realizing  the  functions  XL  and  ~V. 

In  terms  of  modelling  or  theorizing  about  adaptive  control,  this  paper 
has  explicitly  used  a two- level  representation  consisting  of  the  adaptor  and  con- 
troller. Manual  control  modelling  should  follow  the  same  scheme.  Adaptation 
is  accomplished  through  a system  with  the  state  transition  structure  and  output 
assignment  structure  shown  in  equations  (20)  and  (21).  The  human  operator 
when  performing  adaptive  control  tasks  realizes  the  system  described  by  (20) 
and  (21).  So  in  behavioral  terms,  modelling  the  human  adaptor  is  the  process 
of  constructing  a structure  with  the  properties  required  by  equations  (20)  and 
(21). 

Formally  then,  modelling  the  human  adaptor  requires  determinations  of 
a state  space  D,  a task  time  set  T,  an  event  time  set  T_,  or  perhaps  simply  the 
set  Tj^,  a family  of  input  sets  (Xg  x Ys)  where  s e T,  and  a family  of  controllers 
CN.  hi  very  few  cases  would  all  of  these  sets  be  obvious  simply  from  observation 
of  the  human  performing  the  tasks.  Particularly,  the  state  space  D is  not  directly 


observable.  In  all  practical  cases  a great  deal  of  structure  is  specified  at  the 
start  of  the  modelling  or  theory  construction.  Specific  representations  would 
typically  be  assumed  for  each  of  the  sets  and  structures  mentioned  above.  Then, 
assumptions  would  be  made  about  possible  representations  of  the  state  transition 
functions  and  output  assignment  functions.  Behaviors  of  the  model  would  then  be 
compared  with  data  drawn  from  human  task  performance  exercises  to  assess  the 
adequacy  of  the  model. 

On  the  surface,  none  of  this  appears  much  different  than  the  human  transfer 
identification  procedures  discussed  in  section  2.  There  are  some  very  real  and 
very  important  differences  however.  First,  transfer  function  (and  optimal  con- 
trol models)  use  as  basic  objects  sets  of  plant  input  and  output  behaviors.  That 
is,  they  are  at  the  level  of  describing  controller  behaviors.  Any  adaptation  dis- 
cussed is  in  terms  of  a very  small  number  of  parameters  needed  to  specify  the 
controller.  The  adaptor  as  described  here  is  defined  with  controller  behaviors 
as  inputs,  but  controllers  themselves,  i.  e. , structures,  as  outputs. 

Essentially  the  level  of  abstraction  used  in  the  analysis  has  been  pushed 
up  from  controller  behavior  to  controllers.  The  simple  cases  considered  in 
adaptive  manual  tracking  obviously  fall  in  this  class,  but  they  are  by  no  means 
general.  The  supervisory  and  discrete  control  tasks  described  in  sections  1 
and  2 do  not  fit  in  the  tracking  scheme,  but  they  do  fit  the  general  structure 
proposed  here.  The  general  case  allows  any  and  all  types  of  realizations  of  the 
functions  XL  and  *V"  and  is  clearly  not  restricted  to  difference  or  differential 
equation  types  of  constructions. 
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The  last  point  to  be  made  here  is  really  an  extension  of  the  point  made 
above.  It  seems  that  manual  control  theory  has  for  too  long  been  tightly  con- 
strained by  the  type  of  mathematical  structure  used  to  model  control  behavior. 

The  focus  has  been  on  technicalities  of  representation  rather  than  on  the  prop- 
erties and  structure  of  the  tasks  involved.  The  framework  presented  here  sug- 
gests that,  abstractly  at  least,  there  are  certain  types  of  objects  and  certain 
types  of  relations  which  must  be  addressed,  but  the  vehicle  of  expression  need 
not  be  fixed.  For  example,  information  processing  theories  might  naturally  be 
used  for  constructively  specifying  the  adaptor.  Hunt  and  Poltrock  (1974)  and 
Anderson  (1976)  are  examples  of  tills  type  of  structure.  The  stochastic  auto- 
mata based  procedures  currently  being  developed  by  this  author  under  AFOSR 
Grant  No.  77-3152  (see  Miller,  1977)  are  also  a possible  means  of  modelling 
adaptation. 

The  direction  seems  clear.  If  manual  control  theories  are  ever  to  ex- 
hibit some  of  context  sensitivity  and  adaptive  behavior  that  humans  actually  dis- 
play, new  representations  will  have  to  be  tried.  Further,  since  the  adaptation 
tasks  are  more  cognitive  in  nature  than  tasks  historically  studied,  the  type  of 
representations  will  probably  have  to  move  toward  the  information  processing 
systems  used  and  proposed  in  cognitive  psychology  and  artificial  intelligence. 

Another  veiy  important  point  about  the  realization  of  the  adaptor  should 
be  made.  As  pointed  out  earlier  the  functions  XL  and  "V  are  in  essence  func- 
tional descriptions.  They  do  not  in  themselves  explain  or  specify  how  they  are 
to  be  computed  or  otherwise  realized.  It  would  probably  be  a mistake  to  consider 
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them  as  single  level  systems.  Humans  almost  certainly  accomplish  these  func- 
tions with  a large  number  of  small  communicating  systems,  probably  a heter- 
archy of  systems.  The  ideas  expressed  by  Turvey,  Shaw  and  Macy  (in  press) 
might  well  help  guide  this  modelling  process. 

In  conclusion,  a purely  behavioral  view  of  adaptation  will  almost  cer- 
tainly not  lead  to  useful  models  of  the  human  adaptor.  Specific  information 
processing  structures  will  have  to  be  postulated,  including  explicit  statements 
about  the  goal  structures  and  the  control  contexts  involved,  and  model  behaviors 
compared  with  human  behaviors.  The  problems  are  abstract  and  complex  and 
all  of  the  representational  Issues  are  by  no  means  clear. 


6.  Summary  and  Conclusions 

The  status  of  manual  control  was  reviewed,  including  a brief  description 
of  the  types  of  theories  and  representations  commonly  used.  It  was  concluded 
that  past  research  on  manual  control  has  been  fairly  tightly  constrained  by  the  types 
of  mathematical  forms  commonly  used  to  describe  control  systems  in  engineering 
terms.  It  was  also  stated,  and  several  references  were  cited  to  support  the 
statement,  that  the  role  of  the  human  operator  in  control  systems  is  evolving 
toward  that  of  a supervisor  and  co-ordinator.  This  evolution  means  that  new 
theories  and  models  of  manual  control  performance  are  required  if  engineering 
design  of  such  systems  is  to  proceed  on  sound  theoretical  and  empirical 
principles. 

With  the  objective  of  clarifying  the  type  of  objects  and  relations  essential 
for  representing  the  adaptive  features  of  the  human  controller,  a structural  de- 
scription of  control  tasks  and  adaptation  was  developed.  This  analysis  resulted 
in  a two-level  description  of  the  adaptive  control  system.  The  lower  level,  or 
controller,  actually  provides  the  interface  with  the  environment  (plant).  The 
upper  level,  the  adaptor,  is  an  information  processing  system  which  maintains 
and  updates  the  knowledge  base  about  the  environment  and  produces  as  output  a 
specification  of  the  lower  level  controller. 

Following  the  work  of  Gaines  (1972)  the  adaptor  was  defined  in  terms  of 
tasks.  Tasks  were  formally  characterized  as  well  posed  control  problems  con- 
sisting of  a control  context,  a goal  structure,  and  a set  of  allowable  controllers. 
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The  adaptor  uses  information  about  past  task  performance  to  specify  the  next 
task  and  to  produce  the  required  controller  for  the  task  so  defined. 

Finally  some  suggestions  about  the  construction  of  models  of  the  human 
adaptor  were  made.  It  was  argued  that  the  most  suitable  models  will  probably 
be  based  on  the  symbol  manipulation  and  knowledge  representation  methods 
currently  used  in  cognitive  psychology  and  artificial  intelligence. 

i 
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A monoid  Is  simply  a set,  say  A,  and  a binary  operation,  say  + , 
+ : A x A A 


(whose  elements  are  typically  written 
( a2,  aj  + a2)) 

which  satisfies  the  following  properties: 

1)  3 element  0 e A 9 V a c A 

a + 0 = 0 + a = a 

2)  V a,  a’,  a"  c A, 

a + (a'  + a"  ) = (a  + a')  + a". 

The  element  0 mentioned  above  is  referred  to  as  the  identity. 


Footnotes: 


1)  Berlinski  (1976),  p.  142. 

2)  As  quoted  in  Berlinski  (1976),  p.  147. 

3)  Berlinski  (1976),  p.  146. 

4)  Gaines  (1972),  p.  182. 
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